Spin Systems and Computational Complexity 
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What is the connection between a cathedral's stained glass 
window and the world's hardest Sudoku puzzle? They are 
more closely connected than you might think. Glass (not 
just stained glass) differs from most materials studied by 
physicists in that it has structure, but not a regular one. 
The elemental composition of glass is not very different 
from quartz, but in quartz, the atoms are arranged in a 
regular crystalline structure, and rearranging the atoms 
to change the structure incurs a large energy cost. In 
contrast, in glass, there are many different arrangements of 
atoms with about the same energy. If liquid silica is cooled 
slowly, it can crystallize into quartz, but if it cools rapidly, 
the result is glass. One atomic configuration is selected, 
more or less at random, when the glass cools, but it is not 
necessarily the lowest-energy one. 

A similar phenomenon can occur with "spin systems," sys- 
tems where the atoms are all stationary and only the di- 
rection of their spins varies from location to location. The 
direction of spin for a classical system is towards the north 
pole of its rotation axis, and a quantum spin similarly has 
a direction, though there is no easy interpretation as rota- 
tion. A magnet is essentially a spin system: the atoms are 
arranged according to the structure of iron or whatever 
material composes the magnet. However, each atom has a 
spin and an associated magnetic field. The magnetic field 
from each atom interacts with the spin of nearby atoms. 
In a "ferromagnet," the spins and magnetic fields from dif- 
ferent atoms tend to line up in the same direction. They 
therefore reinforce each other, and add together to produce 
a field much larger than the magnetic field of any individ- 
ual atom. Iron is a ferromagnetic material, and permanent 
magnets result from an interaction of this type. Some 
other materials are "antiferromagnets." In an antiferro- 
magnet, the magnetic fields of neighboring atoms tend to 
face opposite directions, and therefore cancel out. Antifer- 
romagnets are less common than ferromagnets, but they 
do occur naturally. In a ferromagnet, the lowest-energy 
state (the "ground state") is just to line up all the spins 
to point the same way, whereas in an antiferromagnet, the 
ground state is for the spins to alternate which direction 
they face, forming a checkerboard pattern. 

Spin systems can display an enormous range of possible 
behaviors. For instance, if we have a randomly mixed ma- 
terial so that some neighboring pairs of atoms have ferro- 




Figure 1. A two-dimensional spin system with random 
magnetic and ferromagnetic bonds. The solid lines indi- 
cate a ferromagnetic bond and the dotted lines indicate 
an antiferromagnetic interaction. Each spin can point up 
or down. This particular configuration has 15 bond con- 
ditions violated, but there are many other configurations 
with the same number of incorrect bonds. 



magnetic interactions whereas other pairs have antiferro- 
magnetic interactions (as in Fig. 1), the system no longer 
has a nice regular lowest-energy state. Instead, there is a 
complicated morass of different states, all of which have 
very similar energies. A spin system that behaves like 
this is called a "spin glass." While it is a subject of dis- 
pute whether there is an actual connection between the 
physics of spin glasses and of window glass, spin glasses 
are nonetheless a fascinating subject in their own right. M 

To study spin systems, physicists generally simplify them 
further. We assume the atoms have truly fixed locations, 
perhaps on a square or cubic lattice, and only the spin 
state of an atom can change. Frequently, we assume that 
only adjacent spins can interact, and that spins which are 
further apart have no direct effect on each other. These 
idealized spin systems can be classical or quantum. In a 
classical spin system, each spin considered by itself has 
a definite direction, and we can describe the system's 
configuration at any given time just by specifying the 
direction of each spin. In a quantum spin system, the 
spins behave quantum mechanically, and thus can be in 
entangled states, where it is not possible to specify the 
state of just one spin, only of all the spins collectively. 

A spin glass does not naturally find its own ground state, 
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Figure 2. An example solved Sudoku problem. The 
values and locations of the large bold numbers are the 
input to the problem. The goal is to fill in the remaining 
locations so that each row, column, and 3x3 subgrid must 
contain exactly one of each digit from 1 to 9. The values 
and locations of the small numbers provide a witness: 
With them in place, it is easy to check that this is a valid 
solution. Given only the bold large numbers, however, it 
is difficult to find a solution. 

but one might imagine that with the aid of a powerful 
computer, we could still learn the lowest possible energy 
state of a spin glass. Not so. Computers have advanced 
dramatically in power in the past few decades, but there 
are still problems that we do not know how to solve. 
Indeed, we believe that some problems, including finding 
the ground state energy of some spin glasses, are inherently 
hard to solve, and that future advances in computer 
engineering will still not let us solve the hardest examples. 

Sudoku is another example of a computationally hard 
problem. (For those who are unfamiliar with it, see figure 2 
for an example.) The examples of Sudoku presented as 
puzzles in newspapers and elsewhere are designed to be 
solvable, but if you remove that crutch and generalize to 
larger k 2 x k 2 grids filled with numbers from 1 to k, many 
examples of the puzzle will be too difficult to solve even 
with the aid of the world's largest computers. 

Computer scientists formalize the relative difficulty of 
various computational problems by categorizing them into 
"complexity classes." To determine what complexity class 
a problem belongs to, one needs to look at its behavior 
for very big examples of the problem. Given any single 
input for the problem, there is just one answer — one 
output — and the amount of time to get that answer might 
depend on what information you start with and exactly 



how your computer works. However, when you look at 
larger and larger inputs for a problem, finding the answer 
typically gets harder and harder, and the approximate rate 
at which it gets harder does not depend on these details. 
For instance, P is the class of problems that are solvable in 
a time which is any polynomial in the size n of the input, 
be it n 2 or n 200 . The exact polynomial rate might depend 
on how your computer is built, but the fact that the growth 
is polynomial in most cases does not. 1 A problem in P is 
generally considered to be solvable in a reasonable time, 
and problems which are not in P are considered to be hard. 
Of course, this is just a simplification — a time scaling 
of n 200 is enough to make the problem hard in practice, 
whereas a time of exp(n/10 200 ) will be over before you 
know it unless n itself is ridiculously large. In addition, the 
scaling refers to the difficulty of solving the very hardest 
inputs; for many, or even most, inputs, the difficulty may 
be much less. Still, it seems to be a reasonable criterion, 
in that it is both well-defined (because P doesn't depend 
on exactly how you define "computer"), and for most 
problems outside P, there seem to be some reasonable-size 
inputs for which we cannot solve the problem. 

Another important complexity class is NP, which, roughly 
speaking, is the class of problems that can be checked in a 
reasonable amount of time. Sudoku is an example, along 
with many other interesting problems. More specifically, 
NP is composed of "yes" or "no" questions (e.g., does 
this Sudoku have a solution?). If the answer for a specific 
input is "yes," there must be some information, called a 
"witness," that will enable you to check in polynomial time 
that the answer is indeed "yes." If the answer is "no," then 
no purported witness should pass this checking procedure. 
For Sudoku, the witness is simply the solution. Finding 
the solution is hard, but if you are given the solution, you 
can easily check that it is valid. Indeed, Sudoku is an 
example of an "NP-complete" problem. ^ NP-complete 
problems are the hardest problems in NP — if you can 
efficiently solve an NP-complete problem for all inputs, 
you can efficiently solve any problem in NP. It is a famous 
open question whether P = NP. We believe it does not, 
and that therefore the NP-complete problems are hard. 

One strategy you might adopt to solve an NP-complete 
problem is to try different potential witnesses. If you 
happen upon a correct witness, it is easy to check, and 
therefore you know the answer is "yes." If you are unable 



There is one major exception: a quantum computer can solve 
some problems in polynomial time which we believe cannot be solved 
in polynomial time on a regular classical computer. P is the class of 
problems solvable in polynomial time on a classical computer. 
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to find a valid witness, you might conclude the answer is 
"no." Of course, the number of potential witnesses is huge; 
there are exponentially many in the input size. You might 
repeatedly modify a potential witness slightly, attempting 
to overcome its defects. For instance, in Sudoku, you 
might take a solution which has a column with two 9s and 
no 3 and change one 9 to a 3. This might create new errors, 
requiring further changes, but perhaps after a few changes 
there will be fewer errors than in your original failed 
solution. Some version of this strategy works quite well for 
many particular inputs. However, the strategy fails on the 
very hardest inputs, because there are very many nearly- 
correct witnesses, and it is very difficult to find the one 
true witness among the forest of false witnesses. In the 
case of Sudoku, there could be many arrangements that 
are incorrect in just a few locations, but the true solution 
might be very different from the almost-correct ones. 

This is precisely the phenomenon that prevents spin 
glasses from settling down to a single state: There are 
many low-energy states, but only one of those (or a few 
at most) has absolutely the smallest energy. Indeed, the 
problem of finding the ground state of a classical spin 
glass is often an NP-complete problem. For instance, 
it is an NP-complete problem to find the ground state 
of a spin system in three dimensions with some mix of 
ferromagnetic, antifcrromagnctic, and zero interactions.^ 

Quantum mechanics adds an additional twist. A "quan- 
tum computer" is a computer whose memory and com- 
putational registers may contain quantum superpositions. 
By taking advantage of this capability, a quantum com- 
puter can solve some problems which seem to be too hard 
for classical computers. The complexity class BQP is de- 
fined as the class of problems which can be solved in poly- 
nomial time on a quantum computer, and we believe BQP 
is bigger than P. For instance, we believe factoring is in 
BQP but not in P: Multiplying two large prime numbers 
together is easy (in P), but going the other way, finding the 
prime factors of a large number, is believed to be hard for 
a classical computer. In contrast, a quantum computer 
could factor numbers in polynomial timeJ 4 ! Small quan- 
tum computers have been built, but it will still be decades 
before we can build one large enough to factor numbers 
that can't be factored with today's classical computers. 

Even without quantum computers, we can study the 
new quantum complexity classes they suggest, such as 
BQP, and try to apply any new insights we gain to 
better understand quantum physics. There is also a 
quantum analogue of NP called QMA. QMA is the class 



of problems that can be efficiently checked on a quantum 
computer. Just as we believe that BQP is bigger than P, 
we believe that QMA is bigger than NP. In other words, 
QMA-complete problems are likely too hard to even be 
efficiently checked on a classical computer. They are 
probably also too hard to solve efficiently with a quantum 
computer. (Indeed, we believe quantum computers can't 
solve every problem in NP either.) 

Finding the ground state energy of a quantum spin glass 
is QMA-complete. That is, if we could solve this problem, 
we could solve any problem in QMA. Thus, quantum 
spin glasses are even more difficult than their classical 
counterparts, which are only NP-complete. In addition, 
more quantum systems are hard than classical systems. 
Finding the ground state energy of a 1-D classical spin 
system is in P — easy — but finding the ground state 
energy of a 1-D quantum spin system is QMA-complete J 5 1 

Now you know how a cathedral's stained glass window 
and the world's hardest Sudoku problem are related. 
Glass is disordered because it has a multitude of nearly- 
optimal configurations, the same effect that makes Sudoku 
and some other computational problems intractable. Of 
course, a stained glass window and a Sudoku puzzle are not 
identical: The difference is that the stained glass window 
is supposed to help you pray, whereas with a really hard 
Sudoku, you can only pray for help. 
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